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Abstract 

The  purpose  of  this  project  was  to  develop  new  numerical  methods  for  the  study  of  the 
expected  behavior  of  stochastic  simulations  (such  as  kinetic  Monte  Carlo,  kMC,  or 
Brownian  Dynamics,  BD)  as  well  as  problems  involving  complex  media  (i.e. 
homogenization,  or  effective  medium  theory).  Many  situations  arise  in  current 
engineering  modeling  where  stochastic  simulators  are  available,  yet  closed  equations  for 
the  expected  behavior  are  not  explicitly  known.  Our  coarse  time-stepper  based  approach 
is  a  bridge  that  connects  microscopic/detailed  simulation  with  macroscopic,  systems  level 
numerical  analysis,  enabling  tasks  like  prediction,  stability  analysis,  controller  design  and 
optimization  to  be  performed  directly  on  the  microscopic  models.  We  have  constructed 
bridges  between  existing  and  future  microscopic  simulation  codes  (kMC,  MD,  MC,  BD, 
LB  etc.)  and  traditional,  continuum  numerical  analysis.  We  trade  function  evaluations  (in 
the  continuum  computations)  for  appropriately  initialized  “bursts”  of  microscopic 
simulations,  executed  over  short  space  and  time  intervals,  followed  by  post-processing 
based  on  system-identification  techniques.  Separation  of  time  scales  is  another  important 
ingredient  of  the  bridge  between  micro-simvilation  and  macro-modeling. 

Objectives 

We  want  to  enable  advanced,  computer-assisted  analysis  and  design  computations  for 
complex,  nonlinear,  distributed  (spatially  varying)  processes  described  by  microscopic 
(atomistic,  stochastic,  agent-based)  models.  We  construct  a  bridge  that  allows  scientific 
computing  tasks  (like  simulation,  stability  and  bifurcation  analysis,  control  and 
optimization)  to  be  performed  for  problems  for  which  the  physical  description  is 
available  at  a  “fine”  microscopic  or  stochastic  level,  but  the  questions  asked  are  at  a 
macroscopic,  systems  level.  This  bridge  takes  the  form  of  software  “wrappers”,  that  can 
be  combined  with  state  of  the  art  microscopic  simulation  codes  (like  kinetic  Monte  Carlo, 
kMC,  equilibrium  MC,  Brownian  Dynamics,  BD,  or  general  agent-based,  AB) 
simulators.  We  can  also  work  with  evolution  equations  in  complex/random  media  (i.e., 
effective  medium  theory),  discrete  media  (e.g.  lattice  dynamics),  and,  fortuitously,  with 
large  scale  legacy  codes,  which  can  also  be  enabled  by  these  “wrappers”.  Systems  theory 


tools  (system  identification,  separation  of  time  scales)  are  vital  in  this  computational 
enabling  technology. 


Accomplishments 

We  have  been  able  to  accelerate  the  simulation,  as  well  as  the  stability  and  bifurcation 
analysis,  and  in  some  cases  the  optimization  and  control  of  several  stochastic  problems, 
(a)  We  demonstrated  how  to  use  coarse  timesteppers  to  control  stochastic  simulations  in 
our  AIChE  J  paper  last  July.  Using  coarse  timesteppers  to  locate  unstable  stationary 
states  of  the  expectation  of  the  kMC  simulations  of  surface  reactions,  we  were  then  able 
to  estimate  the  action  of  the  slow  coarse  Jacobian  using  matrix-free  methods,  and  used  it 
to  design  a  macroscopic  stabilizing  controller,  (b)  Our  work  on  the  coarse  time-stepper 
based  analysis  of  Brownian  Dynamics  problems  appeared  in  J.  Chem.  Phys.  last  June;  we 
were  able  to  compute  the  bifurcation  behavior  of  the  orientation  statistics  of  nematic 
liquid  crystals  by  acting  directly  on  the  Brownian  Dynamics  simulator,  (c)  Two 
publications  are  in  the  final  steps  of  completion  from  a  collaboration  with  Prof.  A.  Z. 
Panagiotopoulos  and  Dr.  Dima  Kopelevich  on  the  coarse  computation  of  equilibrium 
Monte  Carlo  simulations,  in  particular  the  acceleration  of  grand  canonical  Monte  Carlo 
simulations  of  micelle  aggregation,  (d)  A  paper  on  the  acceleration  of  kMC  simulations 
of  dislocation  dynamics  was  recently  submitted  to  Pf^s.  Rev.  Letters  in  collaboration 
with  Prof.  D.  Srolovitz  and  Dr.  Mikko  Haataja.  (e)  We  have  started  a  collaboration  with 
Prof  G.  Kamiadakis  and  Dr.  Dongbin  Xiu  at  Brown,  on  combining  the  “polynomial 
chaos”  theory  (Spanos  and  Ghanem)  widi  our  coarse  computations.  In  addition,  we  have 
also  started  a  collaboration  with  Prof  Ghanem  and  his  student  You  along  these  lines  on 
the  coarse  computation  of  passive  scalar  transport.  We  started  working  with  Prof.  J. 
Rawlings  of  the  U.  of  Wisconsin  on  coarse  model  predictive  control,  as  well  as  with 
Profs.  Stuart  and  Barkley  of  the  U.  of  Warwick  on  coarse  optimization,  (f)  With  Prof.  S. 
Levin  at  Princeton,  Prof  Gear  and  Dr.  Cistemas,  we  were  able  to  accelerate  computations 
in  evolutionary  epidemiology  (agent  based  models  of  evolving  diseases  and  of  influenza 
A  in  particular.  A  paper  from  this  work  was  recently  submitted  to  Proc.  Roy.  Soc.  London 
and  one  more  paper  will  be  submitted  shortly  to  Proc.  Natl.  Acad.  Sci.  USA.  (g)  With  Dr. 
Siettos  and  Prof  Maroudas  from  Umass  we  have  a  paper  in  press  in  Int.  J.  Bif.  Chaos  on 
augmented  ensembles  for  the  computation  of  unstable  branches  of  stochastic  simulators, 
(h)  With  Drs.  Runborg  and  Moeller  at  KTH  in  Sweden  we  have  submitted  a  paper  to 
Nonlinearity  on  the  computation  of  the  effective  behavior  of  discrete  media  (which  has 
applications  to  neuron  lattices),  (i)  With  Dr.  Xiu  (last  year  from  Brown  and  now  from 
Los  Alamos)  we  have  started  working  towards  the  study  of  diffusion  in  random  media  as 
a  fundamental  example  of  the  coarse  timestepping  and  patch  dynamics  applied  to 
problems  depending  on  random  variables,  (k)  With  Dr.  S.-J.  Moon  we  have  been 
studying  the  dynamics  of  ensembles  of  coupled  oscillators;  a  paper  from  this  work  will  be 
soon  submitted  to  Phys.  Rev.  Letters.  The  collaboration  (wi^  the  Fritz-Haber  Institut  in 
Berlin)  on  addressable  catalytic  media  (as  examples  of  complex  media)  had  2  Phys.  Rev. 
Letters,  a  review  paper  in  J.  Catalysis  as  well  as  a  Science  article  this  summer.  A 
collaboration  started  with  Los  Alamos  National  Laboratory  towards  particle-based 
filtering  (coarse  integration  of  Fokker-Planck  equations  based  on  which  estimation  and 
prediction  are  made).  Collaborations  with  Professors  Yip  (MIT)  and  Li  (Ohio  State)  on 


computational  materials  science  led  to  a  Proceedings  publication  and  will  continue;  with 
Profs.  Tannenbaum  and  Ben  Arous  on  particle-based  algorithms  for  image  processing 
another  collaboration  just  started.  We  should  also  mention  (1)  our  work  on  accelerating 
chemotactic  computations  with  Drs.  Setayeshgar  and  Siettos,  and  Profs.  Othmer  and 
Gear,  which  was  submitted  for  publication  to  SIAM  MMS  late  this  summer. 

In  summary,  several  examples  were  successfully  tackled  and  extensive  experience  was 
acquired  in  the  acceleration  of  systems  level  analysis  based  on  microscopic/stochastic 
codes.  Many  of  these  attempts  are  now  becoming  individual  research  programs.  The 
collaboration  witii  Umass  on  computational  materials  science  issues  will  also  continue. 
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University  of  Massachusetts  TECHNICAL  REPORT 
RESEARCH  ACUVITIES 

Research  activities  at  U,  Mass,  were  centered  around  two  main  themes:  (i)  development 
of  stochastic  and  deterministic  descriptions  of  microscopic  dynamics  with  emphasis  on  kinetic 
Monte  Carlo  (JCMC)  and  finite-temperature  molecular-dynamics  (MD)  simulations  and  (ii) 
applications  of  these  simulations  toward  expected-dynamics  studies  following  the  coarse-time- 
stepper-based  approach  developed  by  Prof.  KevreWdis  and  his  research  group  at  Princeton 
University.  In  fee  case  of  KMC  simulation,  we  focused  on  lattice  Monte  Carlo  descriptions  of 
surface  transport  and  reaction  processes  and  worked  closely  wife  fee  Princeton  group.  Future 
work  also  will  include  simulations  of  thin-film  and  nanostructure  growth  through  hybrid  ofif- 
lattice  BCMC  schemes  feat  we  are  currently  developing  at  U.Mass.  In  fee  case  of  MD  simulation, 
we  developed  coarse  finite-temperature  MD  tools  for  model  bulk  systems  wife  interatomic 
interactions  described  by  simple  Lennard-Jones  (pair)  potentials;  in  addition,  we  addressed  a 
suite  of  materials  mechanics  problems  in  metallic  systems  wife  interatomic  interactions 
described  either  by  simple  Morse  (pair)  potentials  or  more  sophisticated  embedded-atom  method 
(many-body)  potentials.  We  have  developed  canonical  (isostrain-isofeermal)  MD  simulators  for 
fee  model  bifec  systems  and  both  canonical  and  isostress-isofeermal  MD  simulators  for  fee 
crystalline  metallic  systems  that  we  studied. 

Our  coarse  KMC  simulations  place  emphasis  on  accelerating  KMC  dynamics  using 
projective  integration  methods  developed  by  Kevrekidis  &  Gear  and  on  conducting  systematic 
bifurcation  andyses  for  “spatially  distributed”  svuface  systems  under  conditions  where  fee  rates 
of  reaction  and  diffusion  are  comparable.  Similarly,  our  coarse  MD  simulations  emphasize  on 
developing  accelerated  MD  schemes  based  on  projective  integration  algorithms  and  on  enabling 
MD-based  bifurcation  analyses  in  a  manner  analogous  to  our  demonstrated  coarse  KMC-based 
system-level  studies.  Our  ultimate  goal  is  to  enable  accelerated-MD-based  system-level  analysis 
for  applications  over  a  broad  range  of  problems  firom  surface  physical  chemistry  to  hard 
materi^s  mechanics.  Much  of  this  work  is  cinrently  in  process;  we  anticipate  feat  our  results 
will  appear  in  a  substantial  number  of  high-quality  publications  (also  see  Publications  section 
below).  Specifically,  we  are  in  fee  process  of  implementing  our  coarse  MD  tools  to  carry  out  an 
ambitious,  comprehensive  parametric  study  of  deformation  and  failure  of  ductile  bulk  metals  and 
metallic  films;  operating  parameters  include:  loading  mode,  applied  strain  rate,  final  applied 
strain,  temperature,  and  thin-film  thickness.  Preliminary  results  have  not  only  contributed  to 
development  of  response  diagrams  but  also  revealed  new  atomic-scale  void  growth  and  material 
failure  mechanisms. 

Furthermore,  theoretical  work  at  U.Mass.  has  focused  on  developing  an  “alternative” 
augmented  Lagrangian  formulation  of  deterministic  atomic-scale  dynamics  aiming  at  predictions 
of  expected  coarse  behavior.  This  formulation  allows  for  MD  simulations  within  an  augmented- 
space  representation  feat  incorporates  directly  into  fee  dynamical  description  fee  coarse 
bifurcation  parameter(s);  therefore,  coarse  bifurcation  analysis  can  be  implemented  as  an  inte^al 
part  of  fee  au^ented  “fine”  (N©)  time  stepper.  Theoretical  development  of  this  alternative 
mefeodology  is  currently  reaching  completion  and  computational  implementation  will  soon 
follow  wife  applications  to  fee  materials  mechanics  problems  discussed  above. 

SPECIFIC  RESEARCH  TASKS  EXECUTED 

•  Development  of  computer  codes  implementing  fee  coarse-time-stepper-based  mefeodology 
arormd  KMC  simulators.  Capabilities  include:  (i)  coarse  projective  KMC  simulation  for 
time-stepping  acceleration,  (ii)  coarse  bifurcation  and  stability  analysis  based  on  KMC 
simulation,  and  (iii)  state-feedback  control-based  approach  for  coarse  bifurcation  analysis  via 
KMC  simiilation; 

•  Application  of  fee  above  tools  utilizing  KMC  simulators  to  study  coupled  surface  reaction 
and  diffusion  processes  on  catalytic  surfaces; 
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•  Development  of  computer  codes  implementing  the  coarse-time-stepper-based  methodology 
around  canonical  (isostrain-isothermal)  and  isostress-isothermal  N&)  simulators  at  finite 
temperature.  Capabilities  include:  (i)  coarse  projective  MD  simulation  that  improves  the 
severe  time-scale  limitations  of  MD  and  (ii)  coarse  bifurcation  and  stability  analysis  via  MD 
simulation; 

•  Application  of  the  above  tools  utilizing  MD  simulators  to  study:  (a)  equilibrium  behavior  of 
crystalline  and  disordered  phases  of  bulk  materials,  (b)  vacancy  clustering  and  void 
formation  in  crystalline  solids  supersaturated  in  vacancies,  (c)  structure  response  of 
crystalline  solids  to  applied  mechanical  loading,  including  fracture  and  structural  transition, 
and  (d)  ductile  void  ^owth  &  failure  in  bulk  metals  &  metdlic  thin  films;  and 

•  Augmented  Lagr^gian  formulation  for  MD-based  system-level  analysis.  Computational 
implementation  will  utilize  the  MD  simulators  developed  in  this  project. 
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A  substantial  body  of  work  that  is  currently  in  progress  will  result  in  many  more 
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molecular-dynamics  simulations. 
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